A Comparison of Vector-based Representations for Semantic Composition
نویسندگان
چکیده
ERRATUM: It has come to our attention that there was a flaw in our use of Socher et al. (2011)’s recursive auto-encoder (RAE). Whereas the original version of this paper used one and the same pair of compositional matrices W (1),W (2) for composing word vectors from all involved sources, in this corrected version we retrained the RAE’s compositional matrices for each word vector source. This somewhat improves accuracy in our paraphrase detection experiment for sentence vectors obtained from the RAE. The outcome of the phrase similarity experiment, however, remains largely unchanged. NLM DM SDS (BNC) (3-BWC) (BNC) + 69.04 73.51 72.93
منابع مشابه
A Joint Semantic Vector Representation Model for Text Clustering and Classification
Text clustering and classification are two main tasks of text mining. Feature selection plays the key role in the quality of the clustering and classification results. Although word-based features such as term frequency-inverse document frequency (TF-IDF) vectors have been widely used in different applications, their shortcoming in capturing semantic concepts of text motivated researches to use...
متن کاملInvestigating Inner Properties of Multimodal Representation and Semantic Compositionality with Brain-based Componential Semantics
Multimodal models have been proven to outperform textbased approaches on learning semantic representations. However, it still remains unclear what properties are encoded in multimodal representations, in what aspects do they outperform the single-modality representations, and what happened in the process of semantic compositionality in different input modalities. Considering that multimodal mod...
متن کاملKnowledge Representation for Comparative Constructions in Extended-HowNet
In this paper, we propose an approach for studying the semantic representations of comparison words and comparative constructions based on the framework of E-HowNet. Our objective is to determine how the semantic composition mechanism works. The proposed method establishes a mapping between grammatical structures and fine-grained event structures for comparative constructions. We encode the eve...
متن کاملVector Space Semantic Parsing: A Framework for Compositional Vector Space Models
We present vector space semantic parsing (VSSP), a framework for learning compositional models of vector space semantics. Our framework uses Combinatory Categorial Grammar (CCG) to define a correspondence between syntactic categories and semantic representations, which are vectors and functions on vectors. The complete correspondence is a direct consequence of minimal assumptions about the sema...
متن کاملNamed Entity Recognition in Persian Text using Deep Learning
Named entities recognition is a fundamental task in the field of natural language processing. It is also known as a subset of information extraction. The process of recognizing named entities aims at finding proper nouns in the text and classifying them into predetermined classes such as names of people, organizations, and places. In this paper, we propose a named entity recognizer which benefi...
متن کاملmwetoolkit+sem: Integrating Word Embeddings in the mwetoolkit for Semantic MWE Processing
This paper presents mwetoolkit+sem: an extension of the mwetoolkit that estimates semantic compositionality scores for multiword expressions (MWEs) based on word embeddings. First, we describe our implementation of vector-space operations working on distributional vectors. The compositionality score is based on the cosine distance between the MWE vector and the composition of the vectors of its...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012